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FIG. 2 
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( START ^ 



IDENTIFY PATH 



r 



710 



OETERHINE GRAPHICS GUIDE THAT PROVIDES SUBSTANTIALLY 
UNOBSTRUCTED VIEW OF INSTRUMENT DURING POSITIONING 



I 



730a 



CONSTRUCT GRAPHICS GUIDE TO FRAME PATH 
(WITH A WINDOW FOR STEPS 730a-b. AN OPENING FOR STEP 730c 
OR A PATTERN OF LINES FOR STEP 730d) 

=□ — 



CONSlflUCT POLYGON THAT 
HAS 2 OPPOSING ENDS 
AND VirOOW FROH OE 
EN) TO TtC OTHER 



zr 



I 



■720 



-730 



730b 



CONSTRUCT PARTIAL CYLINDER 
THAT HAS FIRST AND SECOND 
BIDS AND UNDOV FROH 
FIRST TO SECOND END 



730c 



CONSTRUCT CIRCLE WITH 
OPENING (TO RESEHBLE 
LETTER CI LARGER WH TIC 
WIDTH OF THE ftHBER 



1 



730d 



CONSTRUCT PATTERN OF LINES SPACED 
TO ALLOW lefflER TO PASS THROUGH 
AT LEAST 2 CONSECUTIVE LIES (OF 
OPnONALLY DIFFERENT SPACING OR 
LENGTH WITH RESPECT TO OTO LIES) 

I 



TRACK OBSERVER AND/OR INSTRUMENT. RENDER 
GRAPHICS GUIDE (e.g.. SOLID. SEMI-TRANSPARENT. TEXTURED. 
OUTLINED. OR COMBINATION THEREOF) IN ALIGNMENT WITH THE PATH 
INCLUDING ORIENTING GUIDE WITH RESPECT TO OBSERVER. AND 
OPTIONALLY RENDER REPRESENTATION OF THE INSTRUMENT 
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OPENING TO TE RIGHT FOR 
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AM) TO THE LER FOR LER- 
HANDED OBSERVER 
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DYNAMICALLY 
ADJUST/RE-ADJUST 
ORIENTATION OF WINDOW 
RELATIVE TO VANTAGE 
POINT OF OBSERVER 
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ORIENT CIRCLE TO 
SUBSTANTIALLY 
ENCLOSE TARGET 
LOCATION. WITH 
OPENING ENCLOSING 
AN AXIS OF TE PATH 
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ORIENT PATTERN TO 
SURROUND TARGET 
LOCATION AN) WITH 
TE AT LEAST IWO 
CONSECUTIVE LIES 
FRAHING TE PATH 
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DYNAMICALLY 
ADJUST/RE-ADJUST 
ORIENTATION OF OPENING 
RELATIVE TO VANTAGE 
POINT OF OBSERVER 
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ORIENTATION OF PATTERN 
OF LINES RELATIVE TO 
VANTAGE POINT OF OBSERVER 
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FIG. IIA 
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DETERMINE A GRAPHICS GUIDE FOR 
POSITIONING AN INSTRUMENT 



1102 



RENDER THE GUIDE SUCH THAT AN 
APPEARANCE OF A PORTION IS) OF THE GUIDE 
IS MODULATED WITH RESPECT TO 
SPACE AND/OR TIME 



1104a 



VARY A TRANSPARENCY OF THE 
PORTION IS) WITH RESPECT TO OTHER 

PORTIONS TO PROVIDE A 
SUBSTANTIALLY UNOBSTRUCTED VIEW 
THROUGH THE PORTION IS) TO THE 
INSTRUMENT lOR PART THEREOF) 
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SEQUENTIALLY VARY A 
TRANSPARENCY OF PORTIONS le.g. 

CONSECUTIVE OR NON- 
CONSECTIVE) DURING PRE-DEFINED 
TIME INTERVAL IS) TO PROVIDE A 
SUBSTANTIALLY UNOBSTRUCTED VIEW 
THROUGH EACH OF THE PORTIONS TO 
THE INSTRUMENT lOR PART THEREOF) 
AS THE TRANSPARENCY IS VARIED 



VARY A TRANSPARENCY OF THE 
PORTION IS) DURING PRE-DEFINED 
TIME INTERVALS TO PROVIDE A 
SUBSTANTIALLY UNOBSTRUCTED VIEW 
THROUGH THE PORTION IS) TO THE 
INSTRUMENT lOR PART THEREOF) 
DURING THE PRE-DEFINED TIME 
INTERVALS 
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( START ) 
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DETERMINE A GRAPHICS GUIDE FOR 
POSITIONING AN INSTRUMENT 
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CONSTRUCT THE GRAPHICS GUIDE 
AS A LINE OR CYLINDER 
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RENDER THE GUIDE SUCH THAT AN 
APPEARANCE OF A PORTION (S) OF THE GUIDE 
IS MODULATED WITH RESPECT TO 
SPACE AND/OR TIME 



1114a 



MODULATE A TRANPARENCY OF THE 
PORTION (S) WITH RESPECT TO TIME 

SO THAT THE LINE/CYLINDER 
REPEATEDLY FADES IN AND OUT OF 
VIEW TO PROVIDE A SUBSTANTIALLY 
UNOBSTRUCTED VIEW OF THE 
INSTRUMENT WHEN THE LINE/ 
CYLINDER IS OUT OF VIEW 
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1114c 



MODULATE A TRANSPARENCY OF THE 
PORTION (S) WITH RESPECT TO TIME 
AND SPACE SO THAT AT LEAST A 
PORTION OF THE INSTRUMENT IS 
SUBSTANTIALLY UNOBSTRUCTED 
WHEN VIEWED THROUGH THE 
PORTION (S) DURING PRE-DEFINED 
TIME INTERVALS 



MODULATE A TRANSPARENCY OF THE 
PORTION(S) SO THAT A PARTIS) OF 
THE INSTRUMENT IS SUBSTANTIALLY 
UNOBSTRUCTED WHEN VIEWED 
THROUGH THE PORTION (S) 



(end) 
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FIG. 12 
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FIG. IBA 
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ESTABLISH A VIEWPOINT. FROM WHICH A LINE OF SIGHT 

TO A POINT ON A TARGET DEFINES A PATH FOR AN 
INSTRUMENT TO FOLLOW DURING A POSITIONING OF THE 
INSTRUMENT TO THE POINT 



1802 



OPTIONALLY RENDER THE TARGET AS A GRAPHICS OBJECT 
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MARK THE PATH WITH A PLURALITY OF GRAPHICAL MARKERS 
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ALIGN THE INSTRUMENT ALONG THE LINE OF SIGHT TO THE 
POINT ON THE TARGET 
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POSITION THE INSTRUMENT TIP ON THE PATH 
AT AN ENTRY POINT ON A SURFACE OF A 
PHYSICAL OBJECT CORRESPONDING TO THE 
TARGET 



IBOBa 
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ROTATE THE INSTRUMENT AROUND THE TIP ON 
THE ENTRY POINT UNTIL THE INSTRUMENT IS 
ALIGNED WITH THE LINE OF SIGHT TOWARD THE 
POINT ON THE TARGET 
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MOVE THE INSTRUMENT ALONG THE PATH TOWARDS THE 
POINT ON THE TARGET 
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FIG. IBB 
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RENDER A GRAPHICS PATH GUIDE (S) FOR 
INDICATING A PATH FOR AN INSTRUMENT TO 
FOLLOW TO A TARGET 
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INDENTIFY AN AXIS MARKER ON THE 
INSTRUMENT THAT IDENTIFIES AN AXIS OF THE 
INSTRUMENT DISPOSED FROM THE FRONT TO 
THE BACK OF THE INSTRUMENT. THE BACK 
FACING THE USER 
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CONSTRUCT AND 
RENDER THE AXIS 
MARKER IS) AS 
A GRAPHICAL 
MARKER. AND 
TRACK THE 
INSTRUMENT TO 
REGISTER THE 
GRAPHICAL 
MARKER (S) 
WITH RESPECT 
TO THE AXIS 
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SELECT AN 
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FEATURE OF 
INSTRUMENT TO 
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MARKER IS) 
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TO INCLUDE 
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GUIDE IS) TO 
ALIGN THE 
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TO THE PATH 
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FIG. 19 
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FIG. 21 
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FIG. 23 



(start) 



DEFINE A POINT ON AN ACTUAL TARGET AND AN ACTUAL PATH TO REACH THE POINT ON THE 

ACTUAL TARGET 



TRACH A POSE OF AN INSTRUMENT WITH RESPECT TO A POSE OF THE ACTUAL TARGET 



CKIOSE AN ORIENTATION OF THE GRAPHICAL REPRESENTATION AROUND THE VIRTUAL LINE OF 
SIGHT ACCORDING TO A POSE OF A USER WITH RESPECT TO THE ACTUAL TARGET 



DETERMINE (BASED ON A SELECTION} THE ORIEMTATim SUCH THAT EAST, WEST. 
NORTH. AND SOUTH CORRESPOf© TO RIGHT. LEF. HBim, AND BACKWARD. 
RESPECTIVELY. FOR THE POSE OF THE USER WHERE USER FACES THE ACTUAL TARGET 



DYNAMICALLY ADJUST THE ORIENTAHON ACCORDING TO A CHAN^ OF THE POSE OF 

THE USER 



DYNAMICALLY ADJUST THE SELECTION WITH RESPECT TO m POSE OF THE USER 



RENDER A KWPHICAL REPRESENTATION OF THE ACTUAL INSTRUMENT AND THE ACTUAL TARGET TO 
OBTAIN A VIRTUAL If^TRUMENT AND A VIRTUAL TAim POINT. RESPECTIVELY. THE ©WHEAL 
REPRESENTATION BEING RENDERED WITH RESPECT TO A VIRTUAL VIEWPOINT FROM WHICH A 
VIRTUAL LINE OF SIGHT TO THE VIRTUAL TARGET POINT COINCIDES WITH A VIRTUAL PATH OR THE 
VIRTUAL INSTRUMENT TO FOLLOW DURING A POSITIONING OF THE ACTUAL INSTRUMENT TO THE 
POM ON THE ACTUAL TARGET. THE VIRTUAL PATH CORRE^ONDING TO THE REAL PATH 
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-230G 

-230Ga 

-230Gb 

-230GC 
-2308 



RENDER KWPHICAL INFORMATION ABOUT A DISTANCE BETWEEN THE ACTUAL INSTRUMENT AND 
TW POINT ON THE ACTUAL TARGET (OPTIONALLY. ACCORDING TO A VIRTUAL CAMERA WITH A 

WIDE m£ LENS) 



OVERLAY THE KWPHICAL INFORMATION ABOUT THE DISTANCE ONTO THE GRAPHICAL 

REPfSSENTATION 



COMBINE THE mAPHICAL REPRESENTATION FROM THE VIRTUAL VIEWPOINT WITH ANOTHER 
GRAPHICAL REPRESENTATION FROM ANOTHER VIRTUAL VIEWPOINT LOOKING AT THE VIRTUAL PATH 

FROM THE SIDE 



COMBM THE GRAPHICAL REPRESENTATION FROM THE VIRTUAL VIEWPOINT WITH AN 
AUGMENTED REALITY VIEW 



ALIGN THE VIRTUAL INSTRUMENT ALONG THE VIRTUAL LINE OF SIGHT OF THE VIRTUAL TARGET 
POINT TO ALIGN THE ACTUAL INSTRUMENT ALONG THE ACTUAL PATH 



MOVE THE ACTUAL INSTRUMENT ALONG THE ACTUAL PATH TOWARDS THE POINT ON THE ACTUAL 

TARGET 
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FIG. 27 



DETERMINE A GRAPHICS PROXIMITY MARKER (S) FOR INDICATING 
A PROXIMITY OF A PREDETERMINED PORTION OF AN INSTRUMENT 

TO A TARGET. PROXIMITY BASED ON. e.g.. FINAL FORWARD 
INSTRUMENT POSITION. MEASURES FOR OUTER/INNER SURFACES/ 
POSITIONS OF TARGET. MEASURES FOR TARGET FRONT AND BACK 
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DETERMINE A GRAPHICS PATH MARKER IS) FOR IDENTIFYING AT 
LEAST ONE PATH FOR THE INSTRUMENT TO THE TARGET 



I 



■2704 



RENDER THE GRAPHICS PROXIMITY MARKER (S) SUCH THAT THE 
PROXIMITY OF THE PREDETERMINED PORTION OF THE INSTRUMENT 
TO THE TARGET IS ASCERTAINABLE BASED ON A POSITION OF A 

MARKER ON THE INSTRUMENT WITH RESPECT TO THE GRAPHICS 
PROXIMITY MARKER (S) 



I 
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RENDER THE GRAPHICS PATH MARKER (S) SUCH THAT THE AT 
LEAST ONE PATH IS IDENTIFIED BY THE GRAPHICS PATH 
MARKER IS) 
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END ^ 



